Effects of neural oscillation power and phase on discrimination performance in a visual tilt illusion.

Neural oscillations reflect fluctuations in the relative excitation/inhibition of neural systems1,2,3,4,5 and are theorized to play a critical role in canonical neural computations6,7,8,9 and cognitive processes.10,11,12,13,14 These theories have been supported by findings that detection of visual stimuli fluctuates with the phase of oscillations prior to stimulus onset.15,16,17,18,19,20,21,22,23 However, null results have emerged in studies seeking to demonstrate these effects in visual discrimination tasks,24,25,26,27 raising questions about the generalizability of these phenomena to wider neural processes. Recently, we suggested that methodological limitations may mask effects of phase in higher-level sensory processing.28 To test the generality of phasic influences on perception requires a task that involves stimulus discrimination while also depending on early sensory processing. Here, we examined the influence of oscillation phase on the visual tilt illusion, in which a center grating has its perceived orientation biased away from the orientation of a surround grating29 due to lateral inhibitory interactions in early visual processing.30,31,32 We presented center gratings at participants' subjective vertical angle and had participants report whether the grating appeared tilted clockwise or counterclockwise from vertical on each trial while measuring their brain activity with electroencephalography (EEG). In addition to effects of alpha power and aperiodic slope, we observed robust associations between orientation perception and alpha and theta phase, consistent with fluctuating illusion magnitude across the oscillatory cycle. These results confirm that oscillation phase affects the complex processing involved in stimulus discrimination, consistent with its purported role in canonical computations that underpin cognition.

Color discrimination in fixed saturation level of patients with acute traumatic injury.

Introduction: Traumatic brain injury (TBI) is an important public health concern and that may lead to severe neural sequels, such as color vision deficits. Methods: We evaluated the color vision of 10 TBI patients with normal cognitive function using a color discrimination test in a fixed saturation level. We also analyzed computerized tomography scans to identify the local of the brain damages. Results: Four TBI patients that had lesions in brain areas of the ventral visual streams, five TBI patients had lesions inferred in brain areas of the dorsal visual stream, and one TBI patient had lesion in the occipital area. All the patients had cognitive and color vision screened and they had characterized the chromatic discrimination at high and low saturation. All participants had no significant cognitive impairment in the moment of the color vision test. Additionally, they had perfect performance for discrimination of chromatic stimulus at high saturation and similar to controls (n = 37 age-matched participants). Three of four TBI patients with lesions in the ventral brain and one patient with lesion in the occipital area had impairment of the chromatic discrimination at low saturation. All TBI patients with lesions in the dorsal brain had performance similar or slightly worse than the controls. Conclusion: Chromatic discrimination at low saturation was associated to visual damage in the ventral region of the brain and is a potential tool for functional evaluation of brain damage in TBI patients.

A hierarchy of visual processing deficits in body dysmorphic disorder: a conceptual review and empirical investigation.

OBJECTIVE: Abnormal visual processing has been proposed as a mechanism underlying excessive focus on minor appearance flaws in body dysmorphic disorder (BDD). Existing BDD research has not differentiated the various stages of face processing (featural, first-order configural, holistic and second-order configural) that are required for higher-order processes such as emotion recognition. This study investigated a hierarchical visual processing model to examine the nature of abnormalities in face processing in BDD. METHOD: Thirty BDD participants and 27 healthy controls completed the Navon task, a featural and configural face processing task and a facial emotion labelling task. RESULTS: BDD participants performed similarly to controls when processing global and local non-face stimuli on the Navon task, when detecting subtle changes in the features and spacing of a target face, and when labelling emotional faces. However, BDD participants displayed poorer performance when viewing inverted faces, indicating difficulties in configural processing. CONCLUSIONS: The findings only partially support prior work. However, synthesis of results with previous findings indicates that heterogenous task methodologies may contribute to inconsistent findings. Recommendations are provided regarding the task parameters that appear most sensitive to abnormalities in BDD.

The phenomenology of pareidolia in healthy subjects and patients with left- or right-hemispheric stroke.

Pareidolia are perceptions of recognizable images or meaningful patterns where none exist. In recent years, this phenomenon has been increasingly studied in healthy subjects and patients with neurological or psychiatric diseases. The current study examined pareidolia production in a group of 53 stroke patients and 82 neurologically healthy controls who performed a natural images task. We found a significant reduction of absolute pareidolia production in left- and right-hemispheric stroke patients, with right-hemispheric patients producing overall fewest pareidolic output. Responses were categorized into 28 distinct categories, with 'Animal', 'Human', 'Face', and 'Body parts' being the most common, accounting for 72% of all pareidolia. Regarding the percentages of the different categories of pareidolia, we found a significant reduction for the percentage of "Body parts" pareidolia in the left-hemispheric patient group as compared to the control group, while the percentage of this pareidolia type was not significantly reduced in right-hemispheric patients compared to healthy controls. These results support the hypothesis that pareidolia production may be influenced by local-global visual processing with the left hemisphere being involved in local and detailed analytical visual processing to a greater extent. As such, a lesion to the right hemisphere, that is believed to be critical for global visual processing, might explain the overall fewest pareidolic output produced by the right-hemispheric patients.

Processing of visual social-communication cues during a social-perception of action task in autistic and non-autistic observers.

Social perception and communication differ between those with and without autism, even when verbal fluency and intellectual ability are equated. Previous work found that observers responded more quickly to an actor's points if the actor had chosen by themselves where to point instead of being directed where to point. Notably, this 'choice-advantage' effect decreased across non-autistic participants as the number of autistic-like traits and tendencies increased (Pesquita et al., 2016). Here, we build on that work using the same task to study individuals over a broader range of the spectrum, from autistic to non-autistic, measuring both response initiation and mouse movement times, and considering the response to each actor separately. Autistic and non-autistic observers viewed videos of three different actors pointing to one of two locations, without knowing that the actors were sometimes freely choosing to point to one target and other times being directed where to point. All observers exhibited a choice-advantage overall, meaning they responded more rapidly when actors were freely choosing versus when they were directed, indicating a sensitivity to the actors' postural cues and movements. Our fine-grained analyses found a more robust choice-advantage to some actors than others, with autistic observers showing a choice-advantage only in response to one of the actors, suggesting that both actor and observer characteristics influence the overall effect. We briefly explore existing actor characteristics that may have contributed to this effect, finding that both duration of exposure to pre-movement cues and kinematic cues of the actors likely influence the choice advantage to different degrees across the groups. Altogether, the evidence suggested that both autistic and non-autistic individuals could detect the choice-advantage signal, but that for autistic observers the choice-advantage was actor specific. Notably, we found that the influence of the signal, when present, was detected early for all actors by the non-autistic observers, but detected later and only for one actor by the autistic observers. Altogether, we have more accurately characterized the ability of social-perception in autistic individuals as intact, but highlighted that detection of signal is likely delayed/distributed compared to non-autistic observers and that it is important to investigate actor characteristics that may influence detection and use of their social-perception signals.

A stimulus exposure of 50 ms elicits the uncanny valley effect.

The uncanny valley (UV) effect captures the observation that artificial entities with near-human appearances tend to create feelings of eeriness. Researchers have proposed many hypotheses to explain the UV effect, but the visual processing mechanisms of the UV have yet to be fully understood. In the present study, we examined if the UV effect is as accessible in brief stimulus exposures compared to long stimulus exposures (Experiment 1). Forty-one participants, aged 21-31, rated each human-robot face presented for either a brief (50 ms) or long duration (3 s) in terms of attractiveness, eeriness, and humanness (UV indices) in a 7-point Likert scale. We found that brief and long exposures to stimuli generated a similar UV effect. This suggests that the UV effect is accessible at early visual processing. We then examined the effect of exposure duration on the categorisation of visual stimuli in Experiment 2. Thirty-three participants, aged 21-31, categorised faces as either human or robot in a two-alternative forced choice task. Their response accuracy and variance were recorded. We found that brief stimulus exposures generated significantly higher response variation and errors than the long exposure condition. This indicated that participants were more uncertain in categorising faces in the brief exposure condition due to insufficient time. Further comparisons between Experiment 1 and 2 revealed that the eeriest faces were not the hardest to categorise. Overall, these findings indicate (1) that both the UV effect and categorical uncertainty can be elicited through brief stimulus exposure, but (2) that categorical uncertainty is unlikely to cause the UV effect. These findings provide insights towards the perception of robotic faces and implications for the design of robots, androids, avatars, and artificial intelligence agents.

Long-term, high-resolution in vivo calcium imaging in pigeons.

In vivo 2-photon calcium imaging has led to fundamental advances in our understanding of sensory circuits in mammalian species. In contrast, few studies have exploited this methodology in birds, with investigators primarily relying on histological and electrophysiological techniques. Here, we report the development of in vivo 2-photon calcium imaging in awake pigeons. We show that the genetically encoded calcium indicator GCaMP6s, delivered by the adeno-associated virus rAAV2/7, allows high-quality, stable, and long-term imaging of neuronal populations at single-cell and single-dendrite resolution in the pigeon forebrain. We demonstrate the utility of our setup by investigating the processing of colors in the visual Wulst, the avian homolog of the visual cortex. We report that neurons in the Wulst are color selective and display diverse response profiles to light of different wavelengths. This technology provides a powerful tool to decipher the operating principles that underlie sensory encoding in birds.

Visuo-Cognitive Phenotypes in Early Multiple Sclerosis: A Multisystem Model of Visual Processing.

BACKGROUND: Cognitive impairment can emerge in the earliest stages of multiple sclerosis (MS), with heterogeneity in cognitive deficits often hindering symptom identification and management. Sensory-motor dysfunction, such as visual processing impairment, is also common in early disease and can impact neuropsychological task performance in MS. However, cognitive phenotype research in MS does not currently consider the relationship between early cognitive changes and visual processing impairment. OBJECTIVES: This study explored the relationship between cognition and visual processing in early MS by adopting a three-system model of afferent sensory, central cognitive and efferent ocular motor visual processing to identify distinct visuo-cognitive phenotypes. METHODS: Patients with clinically isolated syndrome and relapsing-remitting MS underwent neuro-ophthalmic, ocular motor and neuropsychological evaluation to assess each visual processing system. The factor structure of ocular motor variables was examined using exploratory factor analysis, and phenotypes were identified using latent profile analysis. RESULTS: Analyses revealed three ocular-motor constructs (cognitive control, cognitive processing speed and basic visual processing) and four visuo-cognitive phenotypes (early visual changes, efferent-cognitive, cognitive control and afferent-processing speed). While the efferent-cognitive phenotype was present in significantly older patients than was the early visual changes phenotype, there were no other demographic differences between phenotypes. The efferent-cognitive and cognitive control phenotypes had poorer performance on the Symbol Digit Modalities Test compared to that of other phenotypes; however, no other differences in performance were detected. CONCLUSION: Our findings suggest that distinct visual processing deficits in early MS may differentially impact cognition, which is not captured using standard neuropsychological evaluation. Further research may facilitate improved symptom identification and intervention in early disease.

Probing the Bottleneck of Awareness Formed by Foveal Crowding: A Neurophysiological Study.

Crowding occurs when an easily identified isolated stimulus is surrounded by stimuli with similar properties, making it very difficult to identify. Crowding is suggested as a mechanism that creates a bottleneck in object recognition and awareness. Recently, we showed that brief presentation times at the fovea resulted in a significant crowding effect on target identification, impaired the target's color awareness, and resulted in a slower reaction time. However, when tagging the target with a red letter, the crowding effect is abolished. Crowding is widely considered a grouping; hence, it is pre-attentive. An event-related potential (ERP) study that investigated the spatial-temporal properties of crowding suggested the involvement of higher-level visual processing. Here, we investigated whether ERP's components may be affected by crowding and tagging, and whether the temporal advantage of ERP can be utilized to gain further information about the crowding mechanism. The participants reported target identification using our standard foveal crowing paradigm. It is assumed that crowding occurs due to a suppressive effect; thus, it can be probed by changes in perceptual (N1, ~160 ms) and attentive (P3 ~300-400 ms) components. We found a suppression effect (less negative ERP magnitude) in N1 under foveal crowding, which was recovered under tagging conditions. ERP's amplitude components (N1 and P3) and the behavioral proportion correct are highly correlated. These findings suggest that crowding is an early grouping mechanism that may be combined with later processing involving the segmentation mechanism.

Drawings reveal changes in object memory, but not spatial memory, across time.

Time has an immense influence on our memory. Truncated encoding leads to memory for only the 'gist' of an image, and long delays before recall result in generalized memories with few details. Here, we used crowdsourced scoring of hundreds of drawings made from memory after variable encoding (Experiment 1) and retentions of that memory (Experiment 2) to quantify what features of memory content change across time. We found that whereas some features of memory are highly dependent on time, such as the proportion of objects recalled from a scene and false recall for objects not in the original image, spatial memory was highly accurate and relatively independent of time. We also found that we could predict which objects were recalled across time based on the location, meaning, and saliency of the objects. The differential impact of time on object and spatial memory supports a separation of these memory systems.

The Interaction of Linguistic and Visual Cues for the Processing of Case in Russian by Russian-German Bilinguals: An Eye Tracking Study.

Modulation of visual attention in the Visual World Paradigm relies on parallel processing of linguistic and visual information. Previous studies have argued that the human linguistic capacity includes an aspect of anticipation of upcoming material. Such anticipation can be triggered by both lexical and grammatical/morphosyntactic cues. In this study, we investigated the relationship between comprehension and prediction by testing how subtle changes in visual representations can affect the processing of grammatical case cues in Russian by Russian-German bilingual children (n = 49, age 8-13). The linguistic manipulation followed previous designs, contrasting SVO and OVS sentences, where the first NP (NP1) was marked with nominative or accusative case, respectively. Three types of visual displays were compared: (i) individual referents (potential agent/theme); (ii) pairs of referents (NP1 + potential agent/theme); and (iii) events (representing interactions between the referents). Participants were significantly more sensitive to the case manipulation when presented with events compared to the other two types of visual display. This suggests that they were able to quickly integrate the thematic role information signaled by grammatical case in the event representations. However, they were less likely to use the case information to anticipate upcoming arguments when the target pictures represented individual referents or pairs of noninteracting referents. We hypothesize that the process of argument anticipation is mediated by the activation of syntactic templates (SVO or OSV, depending on the case marking on NP1). The relatively weak anticipation effect observed may be attributed to the absence, or weak representation, of the noncanonical OVS template in the bilingual children's long-term memory.

Visual-Motor Processing Speed and Reaction Time Differences between Medically-At-Risk Drivers and Healthy Controls.

This cross-sectional study compared visual-motor processing speed and reaction times between medically-at-risk drivers and normal controls to determine if the time in seconds distinguished between drivers who pass, fail, or need restrictions based on a road test. The medically-at-risk drivers' data (N = 35, 28-89 years) were collected as part of a comprehensive driving evaluation and coded by diagnosis (e.g., cognitive, neurological, medical) and driving outcome. The healthy control (N = 121, 21-79 years) data were collected in previous studies. The Vision Coach™ Full Field 60 task was used to collect reaction times in seconds between the two groups. Independent t-tests showed a significant difference (p < .001) in trial times between healthy controls and medically-at-risk adults. No significant difference (p = .141) was found between the three diagnoses groups. The resulting scores from the Vision Coach™ demonstrated a significant different (p < .001) between those who were determined fit to drive without restrictions and those who were determined not fit to drive after a comprehensive driving evaluation, showing the potential to be used as a screening tool for determining driving risk.

The emergence of the EEG dominant rhythm across the first year of life.

The spectral composition of EEG provides important information on the function of the developing brain. For example, the frequency of the dominant rhythm, a salient features of EEG data, increases from infancy to adulthood. Changes of the dominant rhythm during infancy are yet to be fully characterized, in terms of their developmental trajectory and spectral characteristics. In this study, the development of dominant rhythm frequency was examined during a novel sustained attention task across 6-month-old (n = 39), 9-month-old (n = 30), and 12-month-old (n = 28) infants. During this task, computer-generated objects and faces floated down a computer screen for 10 s after a 5-second fixation cross. The peak frequency in the range between 5 and 9 Hz was calculated using center of gravity (CoG) and examined in response to faces and objects. Results indicated that peak frequency increased from 6 to 9 to 12 months of age in face and object conditions. We replicated the same result for the baseline. There was high reliability between the CoGs in the face, object, and baseline conditions across all channels. The developmental increase in CoG was more reliable than measures of mode frequency across different conditions. These findings suggest that CoG is a robust index of brain development across infancy.

Neural mechanisms of visual motion extrapolation.

Because neural processing takes time, the brain only has delayed access to sensory information. When localising moving objects this is problematic, as an object will have moved on by the time its position has been determined. Here, we consider predictive motion extrapolation as a fundamental delay-compensation strategy. From a population-coding perspective, we outline how extrapolation can be achieved by a forwards shift in the population-level activity distribution. We identify general mechanisms underlying such shifts, involving various asymmetries which facilitate the targeted 'enhancement' and/or 'dampening' of population-level activity. We classify these on the basis of their potential implementation (intra- vs inter-regional processes) and consider specific examples in different visual regions. We consider how motion extrapolation can be achieved during inter-regional signaling, and how asymmetric connectivity patterns which support extrapolation can emerge spontaneously from local synaptic learning rules. Finally, we consider how more abstract 'model-based' predictive strategies might be implemented. Overall, we present an integrative framework for understanding how the brain determines the real-time position of moving objects, despite neural delays.

Prolonged neural encoding of visual information in autism.

Autism spectrum disorder (ASD) is associated with a hyper-focused visual attentional style, impacting higher-order social and affective domains. The understanding of such peculiarity can benefit from the use of multivariate pattern analysis (MVPA) of high-resolution electroencephalography (EEG) data, which has proved to be a powerful technique to investigate the hidden neural dynamics orchestrating sensory and cognitive processes. Here, we recorded EEG in typically developing (TD) children and in children with ASD during a visuo-spatial attentional task where attention was exogenously captured by a small (zoom-in) or large (zoom-out) cue in the visual field before the appearance of a target at different eccentricities. MVPA was performed both in the cue-locked period, to reveal potential differences in the modulation of the attentional focus, and in the target-locked period, to reveal potential cascade effects on stimulus processing. Cue-locked MVPA revealed that while in the TD group the pattern of neural activity contained information about the cue mainly before the target appearance, the ASD group showed a temporally sustained and topographically diffuse significant decoding of the cue neural response even after the target onset, suggesting a delayed extinction of cue-related neural activity. Crucially, this delayed extinction positively correlated with behavioral measures of attentional hyperfocusing. Results of target-locked MVPA were coherent with a hyper-focused attentional profile, highlighting an earlier and stronger decoding of target neural responses in small cue trials in the ASD group. The present findings document a spatially and temporally overrepresented encoding of visual information in ASD, which can constitute one of the main reasons behind their peculiar cognitive style.

Individual prediction tendencies do not generalize across modalities.

Predictive processing theories, which model the brain as a "prediction machine", explain a wide range of cognitive functions, including learning, perception and action. Furthermore, it is increasingly accepted that aberrant prediction tendencies play a crucial role in psychiatric disorders. Given this explanatory value for clinical psychiatry, prediction tendencies are often implicitly conceptualized as individual traits or as tendencies that generalize across situations. As this has not yet explicitly been shown, in the current study, we quantify to what extent the individual tendency to anticipate sensory features of high probability generalizes across modalities. Using magnetoencephalography (MEG), we recorded brain activity while participants were presented with a sequence of four different (either visual or auditory) stimuli, which changed according to predefined transitional probabilities of two entropy levels: ordered vs. random. Our results show that, on a group-level, under conditions of low entropy, stimulus features of high probability are preactivated in the auditory but not in the visual modality. Crucially, the magnitude of the individual tendency to predict sensory events seems not to correlate between the two modalities. Furthermore, reliability statistics indicate poor internal consistency, suggesting that the measures from the different modalities are unlikely to reflect a single, common cognitive process. In sum, our findings suggest that quantification and interpretation of individual prediction tendencies cannot be generalized across modalities.

Neural Endophenotype Assessment in Zebrafish Larvae Using Optomotor and ZebraBox Locomotion Assessment.

Due to the highly conserved genetics across the central nervous system, the easily probed visual system can act as an endophenotype for assessing neurological function. Here, we describe a psychophysics approach to assess visually driven swimming behavior in the high-throughput zebrafish genetic model system. We use the optomotor response test together with general locomotion behavior to assess neural processing while excluding motor defects related to muscle function.

Heterogeneous presynaptic receptive fields contribute to directional tuning in starburst amacrine cells.

The processing of visual information by retinal starburst amacrine cells (SACs) involves transforming excitatory input from bipolar cells (BCs) into directional calcium output. While previous studies have suggested that an asymmetry in the kinetic properties of BCs along the soma-dendritic axes of the postsynaptic cell could enhance directional tuning at the level of individual branches, it remains unclear whether biologically relevant presynaptic kinetics contribute to direction selectivity (DS) when visual stimulation engages the entire dendritic tree. To address this question, we built multicompartmental models of the bipolar-SAC circuit and trained them to boost directional tuning. We report that despite significant dendritic crosstalk and dissimilar directional preferences along the dendrites that occur during whole-cell stimulation, the rules that guide BC kinetics leading to optimal DS are similar to the single-dendrite condition. To correlate model predictions to empirical findings, we utilized two-photon glutamate imaging to study the dynamics of bipolar release onto ON- and OFF-starburst dendrites in the murine retina. We reveal diverse presynaptic dynamics in response to motion in both BC populations; algorithms trained on the experimental data suggested that the differences in the temporal release kinetics are likely to correspond to heterogeneous receptive field properties among the different BC types, including the spatial extent of the center and surround components. In addition, we demonstrate that circuit architecture composed of presynaptic units with experimentally recorded dynamics could enhance directional drive but not to levels that replicate empirical findings, suggesting other DS mechanisms are required to explain SAC function. Our study provides new insights into the complex mechanisms underlying DS in retinal processing and highlights the potential contribution of presynaptic kinetics to the computation of visual information by SACs.

Evolution of the visual system in ray-finned fishes.

The vertebrate eye allows to capture an enormous amount of detail about the surrounding world which can only be exploited with sophisticated central information processing. Furthermore, vision is an active process due to head and eye movements that enables the animal to change the gaze and actively select objects to investigate in detail. The entire system requires a coordinated coevolution of its parts to work properly. Ray-finned fishes offer a unique opportunity to study the evolution of the visual system due to the high diversity in all of its parts. Here, we are bringing together information on retinal specializations (fovea), central visual centers (brain morphology studies), and eye movements in a large number of ray-finned fishes in a cladistic framework. The nucleus glomerulosus-inferior lobe system is well developed only in Acanthopterygii. A fovea, independent eye movements, and an enlargement of the nucleus glomerulosus-inferior lobe system coevolved at least five times independently within Acanthopterygii. This suggests that the nucleus glomerulosus-inferior lobe system is involved in advanced object recognition which is especially well developed in association with a fovea and independent eye movements. None of the non-Acanthopterygii have a fovea (except for some deep sea fish) or independent eye movements and they also lack important parts of the glomerulosus-inferior lobe system. This suggests that structures for advanced visual object recognition evolved within ray-finned fishes independent of the ones in tetrapods and non-ray-finned fishes as a result of a coevolution of retinal, central, and oculomotor structures.

Prefrontal activity sharpens spatial sensitivity of extrastriate neurons.

Prefrontal cortex is known to exert its control over representation of visual signals in extrastriate areas such as V4. Frontal Eye Field (FEF) is suggested to be the proxy for the prefrontal control of visual signals. However, it is not known which aspects of sensory representation within extrastriate areas are under the influence of FEF activity. We employed a causal manipulation to examine how FEF activity contributes to spatial sensitivity of extrastriate neurons. Finding FEF and V4 areas with overlapping response field (RF) in two macaque monkeys, we recorded V4 responses before and after inactivation of the overlapping FEF. We assessed spatial sensitivity of V4 neurons in terms of their response gain, RF spread, coding capacity, and spatial discriminability. Unexpectedly, we found that in the absence of FEF activity, spontaneous and visually-evoked activity of V4 neurons both increase and their RFs enlarge. However, assessing the spatial sensitivity within V4, we found that these changes were associated with a reduction in the ability of V4 neurons to represent spatial information: After FEF inactivation, V4 neurons showed a reduced response gain and a decrease in their spatial discriminability and coding capacity. These results show the necessity of FEF activity for shaping spatial responses of extrastriate neurons and indicates the importance of FEF inputs in sharpening the sensitivity of V4 responses.